Video Mosaicing using Manifold Projection

Video mosaicing is commonly used to increase the visual eld of view by pasting together many video frames. Existing mosaicing methods are eeective only in very limited cases where the image motion is almost a uniform translation or the camera performs a pure pan. Forward camera motion or camera zoom are very problematic for traditional mosaicing. A mosaicing methodology to allow image mosaicing in the most general cases is presented, where frames in the video sequence are transformed such that the optical ow becomes parallel. This transformation is modelled by a projection of the scene into some manifold. Manifold projection enables to deene high-quality mosaicing even for the most challenging cases of forward motion and of zoom. In addition, view interpolation, generating dense intermediate views, is used to overcome parallax eeects.